Evaluating climate models with the CLIVAR 2020 ENSO Metrics Package

El Niño–Southern Oscillation (ENSO) is the dominant mode of interannual climate variability on the planet, with far-reaching global impacts. It is therefore key to evaluate ENSO simulations in state-of-the-art numerical models used to study past, present, and future climate. Recently, the Pacific Region Panel of the International Climate and Ocean: Variability, Predictability and Change (CLIVAR) Project, as a part of the World Climate Research Programme (WCRP), led a community-wide effort to evaluate the simulation of ENSO variability, teleconnections, and processes in climate models. The new CLIVAR 2020 ENSO metrics package enables model diagnosis, comparison, and evaluation to 1) highlight aspects that need improvement; 2) monitor progress across model generations; 3) help in selecting models that are well suited for particular analyses; 4) reveal links between various model biases, illuminating the impacts of those biases on ENSO and its sensitivity to climate change; and to 5) advance ENSO literacy. By interfacing with existing model evaluation tools, the ENSO metrics package enables rapid analysis of multipetabyte databases of simulations, such as those generated by the Coupled Model Intercomparison Project phases 5 (CMIP5) and 6 (CMIP6). The CMIP6 models are found to significantly outperform those from CMIP5 for 8 out of 24 ENSO-relevant metrics, with most CMIP6 models showing improved tropical Pacific seasonality and ENSO teleconnections. Only one ENSO metric is significantly degraded in CMIP6, namely, the coupling between the ocean surface and subsurface temperature anomalies, while the majority of metrics remain unchanged

2016 International Land Model Benchmarking (ILAMB) Workshop Report

As earth system models (ESMs) become increasingly complex, there is a growing need for comprehensive and multi-faceted evaluation of model projections. To advance understanding of terrestrial biogeochemical processes and their interactions with hydrology and climate under conditions of increasing atmospheric carbon dioxide, new analysis methods are required that use observations to constrain model predictions, inform model development, and identify needed measurements and field experiments. Better representations of biogeochemistryclimate feedbacks and ecosystem processes in these models are essential for reducing the acknowledged substantial uncertainties in 21st century climate change projections

Long-term sea-level change revisited: the role of salinity

Of the many processes contributing to long-term sea-level change, little attention has been paid to the large-scale contributions of salinity-driven halosteric changes. We evaluate observed and simulated estimates of long-term (1950-present) halosteric patterns and compare these to corresponding thermosteric changes. Spatially coherent halosteric patterns are visible in the historical record, and are consistent with estimates of long-term water cycle amplification. Our results suggest that long-term basin-scale halosteric changes in the Pacific and Atlantic are substantially larger than previously assumed, with observed estimates and coupled climate models suggesting magnitudes of ∼25% of the corresponding thermosteric changes. In both observations and simulations, Pacific basin-scale freshening leads to a density reduction that augments coincident thermosteric expansion, whereas in the Atlantic halosteric changes partially compensate strong thermosteric expansion via a basin-scale enhanced salinity density increase. Although regional differences are apparent, at basin-scales consistency is found between the observed and simulated partitioning of halosteric and thermosteric changes, and suggests that models are simulating the processes driving observed long-term basin-scale steric changes. Further analysis demonstrates that the observed halosteric changes and their basin partitioning are consistent with CMIP5 simulations that include anthropogenic CO _2 forcings ( Historical ), but are found to be inconsistent with simulations that exclude anthropogenic forcings ( HistoricalNat )

Evaluation of Climate Models. In: Climate Change 2013: The Physical Science Basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change

Climate models have continued to be developed and improved since the AR4, and many models have been extended into Earth System models by including the representation of biogeochemical cycles important to climate change. These models allow for policy-relevant calculations such as the carbon dioxide (CO2) emissions compatible with a specified climate stabilization target. In addition, the range of climate variables and processes that have been evaluated has greatly expanded, and differences between models and observations are increasingly quantified using ‘performance metrics’. In this chapter, model evaluation covers simulation of the mean climate, of historical climate change, of variability on multiple time scales and of regional modes of variability. This evaluation is based on recent internationally coordinated model experiments, including simulations of historic and paleo climate, specialized experiments designed to provide insight into key climate processes and feedbacks and regional climate downscaling. Figure 9.44 provides an overview of model capabilities as assessed in this chapter, including improvements, or lack thereof, relative to models assessed in the AR4. The chapter concludes with an assessment of recent work connecting model performance to the detection and attribution of climate change as well as to future projections

Improved estimates of upper-ocean warming and multi-decadal sea-level rise

Changes in the climate system’s energy budget are predominantly revealed in ocean temperatures1,2 and the associated thermal expansion contribution to sea-level rise2. Climate models, however, do not reproduce the large decadal variability in globally averaged ocean heat content inferred from the sparse observational database3,4, even when volcanic and other variable climate forcings are included. The sum of the observed contributions has also not adequately explained the overall multi-decadal rise2. Here we report improved estimates of near-global ocean heat content and thermal expansion for the upper 300 m and 700 m of the ocean for 1950–2003, using statistical techniques that allow for sparse data coverage5,6,7 and applying recent corrections8 to reduce systematic biases in the most common ocean temperature observations9. Our ocean warming and thermal expansion trends for 1961–2003 are about 50 per cent larger than earlier estimates but about 40 per cent smaller for 1993–2003, which is consistent with the recognition that previously estimated rates for the 1990s had a positive bias as a result of instrumental errors8,9,10. On average, the decadal variability of the climate models with volcanic forcing now agrees approximately with the observations, but the modelled multi-decadal trends are smaller than observed. We add our observational estimate of upper-ocean thermal expansion to other contributions to sea-level rise and find that the sum of contributions from 1961 to 2003 is about 1.5 ± 0.4 mm yr-1, in good agreement with our updated estimate of near-global mean sea-level rise (using techniques established in earlier studies6,7) of 1.6 ± 0.2 mm yr-1